This scorecard is shared privately with clients and readers of the studio. If you were sent this link, the password came with it.
We built this scorecard out of our own negotiations with customer service AI vendors. A demo is the product at its best. These 8 questions are about what happens after, in production. Use the scorecard interactively, or load it into ChatGPT or Claude and run it as a prompt.
{{ q.context }}
{{ q.good }}
{{ q.bad }}
Your answers update this in real time. Below, the total tells you whether you're looking at a partner, a risk, or a walkaway.
{{ verdictDesc }}
The vendor has operational transparency. Proceed with a contract review focused on SLA language and data ownership clauses.
Clarify flagged questions in writing before signing. Red flags in pricing, data ownership, and maintenance scope are contract-level risks.
This vendor cannot answer basic operational questions. That inability is itself a preview of how your team will be treated post-contract.
Copy the whole framework as a prompt. Your assistant will ask for your context and the list of vendors you're comparing, then walk you through each of the 8 questions per vendor, keep a running scoring table across all of them, and return individual evaluations plus a side-by-side recommendation at the end.
Opens Claude in a new tab. Paste (⌘V) into a fresh chat.
Opens ChatGPT in a new tab. Paste (⌘V) into a fresh chat.
Running an evaluation and want a second pair of eyes on the answers?
Message Kateryna →